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8.6.0 End of Chapter Problems 

Problem 1 

Let X be the weight of a randomly chosen individual from a population of adult men. In order 
to estimate the mean and variance ofX, we observe a random sample X x JC 2 -’"‘’X\o- Thus, the 

X-s are i.i.d. and have the same distribution as X. We obtain the following values (inpounds): 

165.5, 175.4, 144.1, 178.5, 168.0, 157.9, 170.1, 202.5, 145.5, 135.7 

Find the values of the sample mean, the sample variance, and the sample standard deviation 
for the observed sample. 


Problem 2 

Let X { ,X 2 , X 3 , . .., X n be a random sample with unknown mean EX i = /i, and unknown 
variance Var(X ; ) = a . Suppose that we would like to estimate 6 = ju . We define the estimator 
0 as 


0 = (X) 2 = 


2X 


Ar= 1 


to estimate 6. Is 0 an unbiased estimator of 01 Why? 


Problem 3 


Let X ], X 2 , X 3 , . .., X n be a random sample from the following distribution 


f/x) = 



for 0 < x < 1 


otherwise 
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where 9 E [ - 2, 2] is an unknown parameter. We define the estimator 0 M as 

@ n = 12X- 6 

to estimate 9. 

a. Is 0 H an unbiased estimator of 91 

b. Is 0 a consistent estimator of 91 

c. Find the mean squared error (MSE) of 0 . 


Problem 4 

LetXj, ...,X 4 be a random sample from a Geometric(p ) distribution. Suppose we observed 
(x l ,x 2 , x 3 , x 4 ) = (2, 3, 3, 5). Find the likelihood function using Px, (pcf, p) = p( I - p) x ‘ 1 as the 
PMF. 


Problem 5 

Let 3f|, ...,X 4 be a random sample from an Exponential^) distribution. Suppose we observed 
(x 1 ,x 2 ,x 3 ,x 4 ) = (2.35, 1.55, 3.25, 2.65). Find the likelihood function using 

fx( x f, 9) = 9e 9x i, for x i > 0 

as the PDF. 


Problem 6 

Often when working with maximum likelihood functions, out of ease we maximize the log- 
likelihood rather than the likelihood to find the maximum likelihood estimator. Why is 
maximizing Z(x; 9) as a function of 9 equivalent to maximizing log L(\; 9)1 
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Problem 7 

LetXbe one observation from a /V(0, a 2 ) distribution. 

a. Find an unbiased estimator of a . 

b. Find the log likelihood, log(Z(x; a 2 )), using 

f ^ 2)= ^k exp lb} 

as the PDF. 

c. Find the Maximum Likelihood Estimate (MLE) for the standard deviation a, & ML - 

Problem 8 

LetXj,. ..,X n be a random sample from a Poisson(X) distribution. 

a. Find the likelihood equation, L(x x , ...,x n ; X), using 

e~ x X x i 

P x {x x , ...,x n ;X) = —JTT 

as the PMF. 

b. Find the log likelihood function and use that to obtain the MLE for X,X ML . 


Problem 9 

In this problem, we would like to find the CDFs of the order statistics. LetX 1? ...,X n be a 
random sample from a continuous distribution with CDF Pj/x) and PDF f^x). Define 
X^ X y ...,X( n ) as the order statistics and show that 

n 

=i(t)[w]‘[i -■wi"-*. 
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Hint: Fix x G R. Let 7 be a random variable that counts the number of XJs < x. Define 
\X- < x] as a "success" and \X- > x} as a "failure," and show that Y ~ Binomial(n,p = F^x)) 


Problem 10 

In this problem, we would like to find the PDFs of order statistics. LetXj, ...,X n be a random 
sample from a continuous distribution with CDF F X (x) and PDF f^x). Define X {] x X {n ) 
as the order statistics. Our goal here is to show that 

f x,F= (i -mn-i - j w'- 

One way to do this is to differentiate the CDF (found in Problem 9) . However, here, we would 
like to derive the PDF directly. Let f x (x) be the PDF ofX^. By definition of the PDF, for 

small 3, we can write 

fx ( j ( x ) S ~ p ( x - x (i) - x + S ) S - 

Note that the event {x <X^ < x + 3} occurs if / — 1 of the XJs are less than x, one of them is 
in [x, x + <5], and n - i of them are larger than x + 3. Using this, find f x ^ (x). 

Hint: Remember the multinomial distribution. More specifically, suppose that an experiment 
has 3 possible outcomes, so the sample space is given by 

S = {m,s 2 ,s 3 }. 

Also, suppose that P(s t ) = p t for / = 1, 2, 3. Then for n = n x + n 2 + n 3 independent trials of 
this experiment, the probability that each appears n i times is given by 


( \ n \ n 2 m 3 

\P\P2Py = ~i 
\n i, n 2 , n 3 / n ^. 


n ! 


« 2 !« 3 ! 


PlPlPF 


Problem 11 
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A random sample Xp X 2 , X 3 , .. ., X 100 is given from a distribution with known variance 

Var(A ( ) = 81. For the observed sample, the sample mean is A = 50.1. Find an approximate 
95% confidence interval for 9 = EX f . 


Problem 12 

To estimate the portion of voters who plan to vote for Candidate A in an election, a random 
sample of size n from the voters is chosen. The sampling is done with replacement. Let 9 be 
the portion of voters who plan to vote for Candidate A among all voters. 

a. How large does n need to be so that we can obtain a 90% confidence interval with 3% 
margin of error? 

b. How large does n need to be so that we can obtain a 99% confidence interval with 3% 
margin of error? 


Problem 13 

Let Xp X 2 , X 3 ,..., X 100 be a random sample from a distribution with unknown variance 

Var(A.) = cr 2 < oo. For the observed sample, the sample mean is X = 110.5, and the sample 
variance is S 2 = 45.6. Find a 95% confidence interval for 9 = EX f . 


Problem 14 

A random sample A 1? X 2 , X 3 ,..., X 36 is given from a normal distribution with unknown 
mean // = EX t and unknown variance Var(X ; ) = crC For the observed sample, the sample mean 

is X = 35.8, and the sample variance is S = 12.5. 

a. Find and compare 90%, 95%, and 99% confidence interval for //. 

b. Find and compare 90%, 95%, and 99% confidence interval for a 2 . 


Problem 15 


https://www.probabilitycourse.com/chapter8/8_6_0_ch_probs.php 


5/11 



9/18/2018 


End of Chapter Problems 


Let XpX 2 , X 3 , X 4 , X 5 be a random sample from a N(ju, 1) distribution, where u is unknown. 
Suppose that we have observed the following values 

5.45, 4.23, 7.22, 6.94, 5.98 

We would like to decide between 

H 0 :ju = n Q = 5, 


H{ii + 5. 


a. Define a test statistic to test the hypotheses and draw a conclusion assuming a = 0.05. 

b. Find a 95% confidence interval around X. Is ju Q included in the interval? How does the 
exclusion of ju Q in the interval relate to the hypotheses we are testing? 


Problem 16 

LetXj, ...,X 9 be a random sample from a N(ju, 1) distribution, where u is unknown. Suppose 
that we have observed the following values 

16.34, 18.57, 18.22, 16.94, 15.98, 15.23, 17.22, 16.54, 17.54 

We would like to decide between 


H 0 :n = Mo = 16, 

H^: ju ^ 16. 

a. Find a 90% confidence interval around X. Is ju 0 included in the interval? How does this 
relate to our hypothesis test? 

b. Define a test statistic to test the hypotheses and draw a conclusion assuming a = 0.1. 


Problem 17 

LetXj, X 2 ,..., W 150 be a random sample from an unknown distribution. After observing this 
sample, the sample mean and the sample variance are calculated to be 
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X= 52.28, .S' 2 = 30.9 

Design a level 0.05 test to choose between 

H q : n = 50, 

H\. ju > 50. 

Do you accept or reject H 0 1 


Problem 18 

Let Xy,X 2 , X 3 , X 4 , X 5 be a random sample from a N(ju, a ) distribution, where u and a are 
both unknown. Suppose that we have observed the following values 

27.72, 22.24, 32.86, 19.66, 35.34 

We would like to decide between 

Hq. ju > 30, 

Hyl [X < 30. 

Assuming a = 0.05, what do you conclude? 


Problem 19 

LetXj, X 2 X| 2 | be a random sample from an unknown distribution. After observing this 
sample, the sample mean and the sample variance are calculated to be 

X= 29.25, S 2 = 20.7 

Design a test to decide between 
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Hq: fi = 30, 

Hf n < 30, 

and calculate the P-value for the observed data. 


Problem 20 

Suppose we would like to test the hypothesis that at least 10% of students suffer from 
allergies. We collect a random sample of 225 students and 21 of them suffer from allergies. 

a. State the null and alternative hypotheses. 

b. Obtain a test statistic and a P-value. 

c. State the conclusion at the a = 0.05 level. 


Problem 21 

Consider the following observed values of (v ; -, y •): 

(-5,-2), (-3,1), (0,4), (2,6), (1,3). 

a. Find the estimated regression line 

A A 

y = Po + Pi x 

based on the observed data. 

b. For each x f , compute the fitted value of v, using 


A A 

y i = + P\ x r 


c. Compute the residuals, e i = v ( - y ( . 

d. Calculate R- squared. 


Problem 22 
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Consider the following observed values of (x t , v ; ): 

(1,3), (3,7). 


a. Find the estimated regression line 

A A 

y = A 0 + P\ x 

based on the observed data. 

b. For each x- p compute the fitted value of v, using 

A A 

y i = A 0 + P\ x i- 

c. Compute the residuals, e i = y i - v ( . 

d. Calculate R- squared. 

e. Explain the above results. In particular, can you conclude that the obtained regression 
line is a good model here? 


Problem 23 

Consider the simple linear regression model 

Y i = Po+P\ x i + £ i> 

where e- s are independent /V(0. rr 2 ) random variables. Therefore, F- is a nonnal random 

'y 

variable with mean f> () + ft \X t and variance a . Moreover, Yj s are independent. As usual, we 
have the observed data pairs (jc 1? Vj), (x 2 ,v 2 ), (x n ,y n ) from which we would like to 
estimate /> () and [i |. In this chapter, we found the following estimators 

Ftx’ 

- A - 

= Y-p X x. 

where 


At 

A 

A 0 
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n — 

s xx = Z 
i= 1 

n - - 

S xy = T( X i~ X )( Y i- V )- 

i= 1 


a. Show that /? j is a normal random variable. 


b. Show that/lj is an unbiased estimator of/? l5 i.e., 


W=Ai- 


c. Show that 


A rr 2 
Var(/t,) = —. 

s xx 


Problem 24 

Again consider the simple linear regression model 

Y i = f j 0 + f j \ x i + 


where <r's are independent N( 0, a z ) random variables, and 


*T’ 

A - A - 

fio = Y ~ fi\ x - 


a. Show that /? 0 is a normal random variable. 

A 

b. Show that is an unbiased estimator of /? 0 , i.e., 
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A 

EW = fi* 


c. For any i = 1, 2, 3,, n, show that 


A 

CovOffj, F.) = 



cr 


2 


5 


XX 


d. Show that 


A - 

CovCAj, F) = 0. 


e. Show that 


A 

Var(/t' () ) 



cr 


2 


<— previous 
next —> 
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